DOCUMENT RESUME 



ED 259 702 



IR 011 734 



AUTHOR 
TITLE 

INSTITUTION 
PUB DATE 
NOTE 

PUB TYPE 

EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



S' neberg, Bert, Jr. 

Computer Assisted Instruction. A Report to the Board. 
Greater Albany Public School District No. 8J, Oreg. 
May 85 
38p. 

Reports - Evaluative/Feasibility (142) 
MF01/PC02 Plus Postage. 

^Attitudes; ^Computer Assisted Instruction; Computers; 
Course Faluation; Courseware; Elementary Education; 
•Evaluation Methods; Instructional Design; 
Instructional Development; * Instructional Improvement; 
Instructional Material Evaluation; *Mathematics 
Achievement; *Mathematics Education; Teaching Methods 
Oregon (Albany) 



ABSTRACT 

This report presents the findings of an evaluation 
conducted in the Greater Albany Public School System 3J (Oregon) to 
determine the effects of computer assisted instruction (CAI) in 
mathematics as delivered by the WICAT System 300 at the Periwinkle 
Elementary School. Evaluation activities were designed and conducted 
to determine whether the participants felt that CAI improved 
elementary school children's math achievement, and to explore 
student, parent, and staff attitudes towared the utilization of this 
instructional technique. The report itself consists of an executive 
summary and five sections: (1) an introduction; (2) a description of 
the existing math curriculum in the elementary school; (3) the 
evaluation design for measuring the changes in student achievement; 
(4) the results of the study; and (5) highlights of the significant 
findings. Major findings indicated that achievement scores improved 
significantly — with the most dramatic improvements among students in 
the second grade — and that students, parents, and staff gave high 
ratings to CAI. (JB) 
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EXECUTIVE SUMMARY 



This report presents the findings of an evaluation of computer assisted 
instruction in mathematics as delivered by the WICAT System 300 installed at 
Periwinkle Elementary School in the Greater Albany Public School District 8J. 

Evaluation activities were designed and conducted to answer two questions: 
fl) Docs computer assisted Instruction improve elementary school children's 
math achievement? (2) How do students, parents and staff feel about computer 
assisted Instruction? 

The primary findings of the evaluation were: 

-ft Achievement s >res 1n math computation and math total (computation and 
concepts/applications combined), when compared to a national norm, 
Improved significantly in three of four student grade-level groups during 
the first year of computer assisted Instruction. Math computation and 
math total scores 1n the fourth grade-level group remained essentially 
constant. 

* The most dramatic improvement in mathematics achievement was among 
primary students who were 1n the 2nd grade 1n 1984-85. Expressed as a 
11 growth percentage, " these students had a 29 percent growth in math 
computation scores. This compares to 9 percent and 15 percent increases 
in the other two grade-level groups that. had significant gains. ^ 

ft Achievement scores in math concepts/applications, when compared to a 
national norm, remained essentially constant for all four grade-level 
groups through the first year of computer assisted instruction. 

ft- There were no significant differences between the number of boys and 
girls whosp math achievement scores either improved or dropped. Both 
sexes shared similarly 1n the mathematics achievement gains associated 
with the first year of computer assisted instruction. 

ft Students gave high ratings to computer assisted instruction both in 1984 

before using WICAT and 1n 1985 after a year of .experience on the system. 

Primary students modified their ratings downward after using the system; 
intermediate students remained the same after using the system. 

ft Parents ind staff, w.ille acknowledging the cost of implementing the 
program, gave favorable ratings to the importance and productivity of 
computer assisted instruction, both in 1984 before WICAT was operational 
and in 1985 after a year of experience with the system. 
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I. INTRODUCTION 



This report, Computer Assisted Instruction: A Report to the Board , consists 
of an Executive Summary and five sections. Section 1 introduces the contents 
of the report. Section 2 describes the math program at Periwinkle and 
includes Information about the WICAT System 300 and the regular math 
curriculum. Section 3 describes the evaluation design that was planned and 
implemented to examine the changes in student achievement, student attitude, 
staff attitude and parent attitude associated with the introduction of 
computer assisted instruction in the math program. Section 4 presents the 
results of the study in considerable detail. Section 5 highlights and briefly 
discusses some of the significant findings of the evaluation. 



II. OVERVIEW OF WICAT COMPUTER SYSTEM * 

The WICAT (World Institute of Computer Assisted Teaching) Computer System was 
installed at Periwinkle Elementary School in the Spring of 1984. Periwinkle 
Elementary, located in a predominately white, middle class, southeast Albany 
neighborhood, serves approximately 370 students in kindergarten through fifth 
grades. The school is staffed with sixteen regular classroom teachers, a 
music specialist, a resource room teacher, a librarian, a part-time counselor 
and other support staff. 

The computer system is located in a regular classroom that has been modified 
to house WICAT. Student terminals a^e located in study carrels. These 
carrels are located around the perimeter of the room on three sides and in an 
island in the center of the room. The management terminal is also located in 
this center island. The computer, which serves all student terminals, is 
located in a small built-in room within the classroom. Because of the heat 
generated by the computer the room is air-conditioned. 

The WICAT System 300, developed by WICAT Systems, Inc., supports thirty 
student workstations with graphics, animation and audio capabilities. Each 
workstation consists of a green monitor, a keyboard and earphones. The System 
300 has a MC68000 processor supported by forty-two co-processors. The System 
was installed with an 84 Mbyte hard disk that has been upgraded to 474 Mbyte 
with a tape drive for backup. Peripheral equipment includes a modem and 
printer. The total cost of t.he hardware and facility modifications was 
approximately $120,000. In addition to the initial costs there is a yearly 
maintenance contract and software lease cost of $18,000. 

System courseware covers the three basics - reading, writing and arithmetic. 
In addition, instructors can also create their own courses and lessons with 
the adaptable WISE courseware development system. WICAT also uses , a 
management system that allows student information to be entered, students to 
be scheduled into each of the curriculum areas and student progress to be 
tracked. Because of the implementation timeline and the availability of 



* This section, "Overview of WICAT Computer System," was written by Elaine 
Wei Is , computer curriculum coord ina tor for the Greater Albany School 
District. 
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courseware, ar1thmet1c/math was the only courseware that students used any 
length of time. Thus, this evaluation only addresses arithmetic. Other 
courseware Is now being Implemented and evaluations will be available in 
another year* 

The WICAT Math curriculum 1s organized around seven subject areas: addition, 
decimals, division, fractions, multiplication, subtraction and whole numbers. 
Each subject area 1s divided into units that correspond to grade levels at 
which the particular subject 1s addressed. Level A corresponds to grades one 
and two, level B to grades three and four and level C grades five and six. 
Each unit contains a series of lessons addressing various skills within the 
subject area, and each lesson contains a series of problems addressing a 
particular skill. The software enables students to practice basic arithmetic 
skills and immediately find out how well they are doing. The program also 
offers tutorial instruction that students can request as they need it. 
Students automatically move from lesson to lesson on the basis of performance. 
Students who score 80% or better on a lesson move ahead. Students who score 
50% or less are given another chance; a second failure results in movement to 
a previous lesson or, in sane cases, to a request to M see your teacher. 11 
Scores between 50 and 80S lead to repetition of the lesson. The program also 
includes a practice mode in which work is recorded but does not affect a 
student^ standing. Teachers assign students ta the placement, progress or 
practice modes. 

The students at Periwinkle started using the WICAT System on March 12, 1984. 
Students continued work through June 1, 1984 and began again on September I0 t 
1984. This evaluation tracks growth through March 1, 1985. This would be 163 
student days with approximately 10 days during that period in which the system 
was not available for use due to down-time or equipment or software 
modifications. Students are in the computer lab for two 25-minute sessions 
one week and three 25-m1nute sessions the next. Averaging the two weeks, each 
student spends about 62 minutes per week on the system. 

The Albany School District is currently using the Real Math curriculum by Open 
Court Publishing Company in the elementary grades (K-5). The WICAT math 
curriculum provides a correlation with the Real Math curriculum as well as 
other publisners 1 materials. The teachers have found the WICAT math 
curriculum an excellent addition to Real Math because it provides extra drill 
and practice. When new skills are introduced in the classroom the WICAT 
curriculum is integrated at that point for drill and practice. The 
terminology used in Real Math is very helpful when students re-group in 
addition and subtraction. Also the use of finger set* and add-on counting 
helps with the WICAT basic addition and subtraction. The WICAT math 
curriculum provides drill and practice in seven curriculum areas. In addition 
to the drill and practice, the students may access the tutorial help sequence 
in most of the lessons. 

Students who have progressed beyond the fifth grade level in their math skills 
aro allowed to progress into the sixth through eighth grade curriculum. This 
provides bright students an added challenge that the Real Math text does not 
have. The curriculum also provides extra practice for remedial students who 
can work dally and need extra work. 
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Minimal keyboard training was required for the students to use the system. 
Students are required to type their sign-1n names when beginning a les*on. 
After the signing-in, they need only to use the numbers on the 10-key pad, '.he 
space bar and the return, delete, escape, right and left arrow keys. In 
addition, to access the help sequence students need to be able to type a 
question mark. Prior to going to the computer lab, paper keyboards were used 
In the classroom to familiarize students with the necessary keys. 

The lab manager, an aide, 1s responsible for the actual operation of the 
computer. The manager enters basic student data Into the system, a signs 
students to different curriculum levels as directed by the teacher, obtains 
printouts of student progress for each teacher, makes a dally tape back-up of 
the hard disk Information, and br1ngs-up each teacher's class as they come to 
the lab. The lab manager Is also available while students are 1n the lab to 
answer questions and to assist the teacher. The lab manager was trained for 
a week at WICAT headquarters in Provo, Utah. This training included use and 
operation of the computer, the administrative functions for student record 
keeping and a general knowledge to the student curriculum. 

Teachers, who are knowledgeable about the Real Math and WICAT curriculums, 
assign students into different areas, monitor student progress via computer 
printouts and help students with questions while in the lab. They were 
trained for a day and a half in Albany by three WICAT staff. The teachers 
then had a week to explore the system prior to students going to the computer 
lab for the first time. Follow-up training by WICAT staff has occurred on a 
periodic basis since the initial training last spring. 



?S:report 19 e 



6 



III. EVALUATION DESIGN 



This section outlines the evaluation activities that were planned and 
conducted to examine changes in student achievement, student attitude, staff 
attitude and parent attitude that are associated with the introduction of 
S???¥ te c r a ' s1sted instruction in a target elementary school, specifically the 
WICAT System 300. The eva'uation design described below was implemented 
because of the presence of the WICAT system. It provides for a description of 
student performance that Periwinkle teachers get from their math program. 
That math program, however, consists of regular instruction using the Real 
Math curriculum in the classroom and WICAT computer assisted ins true tiorTTn 
the lab. The design cannot demonstrate a casual relationship between the 
WICAT system and observed changes in student achievement levels and in student 
attitudes. Results must be generally attributed to the total math program, 
hit some considerations may permit them to be associated to or linked with the 
V. "AT system. 



STUDENT ACHIEVEMENT 

The Comprehensive Tests of Basic Skills (CTBS/U) battery was used to assess 
student achievement. It provided basic achievement measures in reading, 
language arts, mathematics, reference skills, science and social studies. 
CTBS/U scores were reported in NCEs or "normal curve equivalents." NCEs, 
ranging from 1 through 99, share some characteristics with percentile ranks. 
NCEs, for example, coincide with percentile ranks at 1, 50 and 99. However, 
they have an added advantage of being based on an equal interval scale, which 
allowed meaningful corr.pjrison between the different tests within the CTBS/U 
battery. 

In Pebruary-March of 1984, all target school students in the 1st through 5th 
grades took the CTBS/U. Teachers, with little direction other than that 
provided by the examiner's manual, administered the CTBS/U in their 
classrooms. Similar testing was conducted at the target school in 1985. The 
district regularly tests 3rd and 5th grade students with the CTBS/U in late 
February and early March. Testing in the target school was scheduled to 
coincide with tne annual district-wide program so that additional testing of 
3rd and 5th grade students would not be required. Since empirical CTBS/U 
norms were established only for fall and spring of the school year, pre-post 
NCE data in this report were based on statistically interpolated norms. 

CTBS/U data were available for four grade-level groups of students in the 
target school. Students were included in one of these groups only if they 
were present for both the pretest and the posttest. Group 1-2, for example, 
took the CTBS/U pretest in 1984 as 1st graders and the posttest in 1985 as 2nd 
graders. Similarly, between the pretest and the posttest Group 2-3 moved from 
the 2nd to the 3rd grade, Group 3-4 moved from the 3rd to 4th grade, and Group 
4-5 moved from the 4th to 5th grade. Between pretest and posttest each 
qrade-level group of students received instruction from five or six different 
teachers. For example, three 1st grade teachers and three 2nd grade teachers 
worked in various comb i nations with students in Group 1-2. 



BS: report 19 e 



btoi COPY AVAILABLE 



The examination of pre-post CTBS/U achievement data addressed three questions: 

1) W*s there a change in the relative achievement levels among target school 
students when compared to the CTBS/U norm? Since NCEs Indicate achievement 
status relative to the norm, changes in pre-post mean NCEs represent shifts of 
group status Relative to the norm. To determine 1f pre-post achievement 
Improved when compared to the norm, a two-tailed t test on repeated measures 
was applied to each of the CTBS/U tests for which pre-post data were 
available. 

2) Was the achievement of target students in mathematics (active W1CAT 
subject) greater than expected when compared to their achievement in non-WlCAT 
subjects? To determine this, a simple linear regression of mean posttest 
scores on mean pretest scores was conducted for each of the four grade-level 
groups of target students. Achievement 1n a particular subject was considered 
"greater than expected" when its obtained mean posttest score was at least one 
standard error of estimate above Its predicted mean score. 

i 

3) Was there a significant difference between the number of boys and the 
number of girls in the target school whose pre-post scores in mathematics 
(active WICAT subject) either improved or dropped? To determine this, Chi 
Square values with correction for continuity were computed for each 
grade-level group of target students from 2x2 contingency tables with change 
in performance (improvement vs. drop) and sex of student (boy vs. girl) as 
variables. Students whose pre-post scores showed no change were excluded from 
the analyses. 



STUDENT ATTITUDE 

A district developed Student Attitude Survey (SAS) f a five-step Likert-type 
scale with a "smiling/frowning face and yes/no" response format suitable for 
young children, was used to assess student attitudes. The SAS produced 
composite attitude measures to three general areas in % the school: curriculum 
(academic), climate and computers. The Student Attitude Survey is shown in 
Appendix A. 

In Spring 1984, and again in Spring 1985, the Student Attitude Survey was 
administered to students in two schools, the target school and a comparison 
school. The comparison school as essentially self-selected; it was a close 
second in the competition for placement of the district's first WICAT system. 
The two schools were similar 1n size, in composition of staff at.d student 
body, and in general curriculum offerings. 

The district's supervisor of program evaluation visited classrooms in both 
schools to administer the Student Attitude Survey, for both pretest and 
posttest. This enhanced the qua! i ty of the atti tude data by assuring a 
uniform administration procedure and by reducing "immediate" teacher influence 
on student responses. As the SAS was given, at their own discretion, 
classroom teachers either left the room or moved to a quiet, work area within 
the room. 
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Student Attitude Survey data were available for four grade-level groups of 
students both in the target school and in the comparison school. Students 
were included 1n one of these groups only 1f they were present for both the 
pretest and the posttest. Group 1-2, for example, took the SAS pretest in 
1984 as 1st graders and the posttest 1n 1985 as 2nd graders. Similarly, 
between the pretest and the posttest Group 2-3 moved from the 2nd to the 3rd 
grade, Group 3-4 moved from the 3rd to 4th grade, and Group 4-5 moved from the 
4th to 5th grade. 

The examination of pre-post student Attitude Survey data addressed three 
questions: 

1) Was there a change of attitudes among target school students on the SAS 
composites (academic, climate and computer) during the first year of WICAT 
operation? To determine if student attitudes had changed, a two-taiied t test 
on repeated measures was applied to pre-post mean ratings generated by each of 
the four student grade-level groups. 

2) Was the attitude of target students toward mathematics (active WICAT 
subject) greater than expected when compared to their attitudes toward 
non-WICAT subjects? To determine this, a simple linear regression of mean 
posttest ratings on mean pretest ratings was conducted for each of the four 
grade-level groups of target students- A student rating of a particular 
subject was considered "greater than expected" when its obtained mean posttest 
rating was at least one standard error of estimate above Its predicted mean 
rating. 

3) Was there a significant difference between the number of target students 
and the number of comparison students whose pre-post composite ratings on the 
Student Attitude Survey either improved or dropped? To determine this, Ch1 
Square with correction for continuity values were calculated for each 
grade-level group from 2x2 contingency tables with school (target vs. 
comparison) and change in attitude (improvements vs. drop; as variables. 
Students whose pre-post scores showed no change were excluded from the 
analyses. 



STAFF ATTITUDE 

A district developed "Staff Survey: Computer Assisted Instruction," a 7-step 
semantic differential with 21 adjective pairs, was used to assess staff 
attitudes. The 7-step scale, defined by Imo'iistic qualifiers "extremely," 
"quite," and "slightly," in both directions from "neutral" yields nearly equal 
psychological units in the process of judgement. The survey produced four 
staff attitude profiles: a 21-item general CA1 profile, a 5-it.em importance 
of CAI subprofile, a 5-item productivity of CAI subprofile, and a 5-item staff 
comfort with using CAI subprofile. The "Staff Survey: Computer Assisted 
Instruction" is shown in Appendix B. 
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The following adjective pairs describing computer assisted Instruction made up 
the three staff subproflles: 

Importance Profile Productivity Profile Staff Comfort P rofii e 

Important-Unimportant .'roductive-Unproductive Familiar-Unknown 

Essential-Frill Efficient-Inefficient Eesygoi. g-Frustreting 

Necessary-Unnecessary Expe'nding-Limitlng Understandable-Puzzling 

Useful-Useless Effective- Ineffective Clear-Confusing 

Valuable-Worthless Time Saving-Consuming Simple-Complicated 

In Spring 1984 and in Spring 1985, the target school staff anonymously 
completed the semantic differential during a regularly scheduled faculty 
meeting. 

Mean ratings on the pre-post administrations of the staff survey formed 
profile patterns of staff attitudes about computer assisted instruction. The 
"sign test of the profile pattern" was used to determine if the staff attitude 
profiles changed significantly during the first year of WICAT operation. The 
one-tailed sign test was applied to the general CAI profile and to each of the 
three CAI subproflles. 

PARFNT ATTITUDE 

A district developed "Parent Survey: Computer Assisted Instruction," a 7-step 
semantic differential with 15 adjective pairs, was used to assess parent 
attitudes. The 7-step scale, defined by linguistic qualifiers "extremely," 
"quite," and "slightly," 1n both directions from "neutral" yields nearly equal 
psychological units in the process of judgement. The survey produced three 
parent attitude profiles; a 15-item general CAI profile, a 5-1tem importance 
of CAI subprofile, and a 5-item productivity of CAI subprofile. The "Parent 
Survey: Computer Assisted Instruction" is shown 1n Appendix C. 

The following adjective pairs describing computer assisted instruction made up 
the two parent subproflles: 

Importance Profile ^ Productivity Profile 

Important-Unimportant Productive-Unproductive 

Essential -Fril 1 Efficient- Inefficient 

Necessary-Unnecessary Expand! ng-Umi ting 

Useful -Useless Effective- Ineffective 

Valuable-Worthless Time Saving-Consuming 

In Spring 1984, parents of target school students in the 1st through 4th 
grades anonymously completed the CAI survey. In Spring 1985, parents of 
target school students in the 2nd through 5th grades completed the survey a 
second time. Thus, essentially one set of parents provided pre-post data. 
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Mean ratings on the pre-post administrations of the parent survey formed 
profile patterns of parent attitudes about computer assisted Instruction. The 
"sign test of the profile pattern" was used to determine if these parent 
attitude profiles changed significantly during the first year of WJ.CAT 
operation. The one-tailed sign test was applied to the general CAI profile 
and to both of the CAI subprofiles. 
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IV, RESULTS 



This section presents the results from the evaluation activities that were 
planned and conducted to examine changes 1n student achievement, student 
attitude, staff attitude and parent attitude that are associated with the 
introduction of computer assisted in< ruction in an elementary school, 
specifically the WICAT System 3C0. 



STUDENT ACHIEVEMENT 

Student achievement results of target school students are displayed on Table 1 
(t test, change, in pre-post mean scores), Table 2 (regression, obtained vs. 
predicted posttest scores) and Table 3 (Ch1 Square, achievement differences 
between boys and girls). 

.« 

The t -test . Achievement scores for students in the target school who were 
present fo> both t^p 19R4 and 1985 administrations of the Comprehensive Te<ts 
of Basic Skills (CTBS/U) are listed on Table 1. A two-tailed, repeated 
measures t~test was computed on .he difference between the pre-post mean NCE 
scores available for each gra e-level group. Since NCEs indicate status 
relative to a norm, observe changes in mean NCEs represent shifts of 
grade-level group status relative to the norm. The data on Table 1 support 
the following statements: 

1) Student achievement in both math computation and math total increased 
significantly in three of the four target grade-level groups. 

2) Group 1-2 experienced the most dramatic increase 1n .iwth achievement. 
Between the 1984 pretest and the 1985 posttest, its mean score on math 
computation increased 15.4 NCEs, from 55. 0 to 70.3. (While not heeding strict 
statistical requirements, some might declare this to be a 28% increase in 
achievement. ) 

3) Group 2-3 dropped in math computation and-math total, but neither decrease 
was statistically significant. 

4) Group 3-4 and Group 4-5 had significant increases in both math computation 
and math total, but under different environments. In Group 3-4, the 
significant increases in math computation and math total complemented the 
group's significant increase on the total battery. In Group 4-5, however, the 
significant increases in math computation and math total contradicted the 
group's significant drop on the total battery. 

5) Target student achievement in math concepts and applications was up in two 
grade-level groups and down in two groups, but none of the pretest-posttest 
differences was statistically significant. 

Regression. Results of the regression analyses on mean pretest-posttest 
CTBS/U scores of target school students are listed on Table 2. A simple 
linear regression of mean posttest scores on mean pretest scores was conducted 
for the three grade-level groups with 10 or more paired subtest-scores (Group 
2-3, Group 3-4, Group 4-5). Using regression techniques to predict posttest 
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* p < .05 ** p < .01 



TABLE 1. REPEATED MEASURES T TEST ON THE CHANGE IN NCE MEAN ACHIEVEMENT SCORES OF 
FOUR GRADE-LEVEL GROUPS IN THE TARGET SCHOOL ON 1981 PRETEST AND 1985 P0STTEST 
ADMINISTRATIONS OF THE "COMPREHENSIVE TESTS OF BASIC SKILLS" (CTBSAi) . 



13 



BEST COPY 



14 





Croup 2*3 


Croup 3-* 




Croup 4-5 




• 

\ 

• 1 




■ 1 1 VAl 


V VAL 


V 


7-Y' 


X VAL 


Y VAL 


Y' 


Y-Y' 


■ J. v*L 


f VAL 


T 


— 7=7* 




62.1 


60.7 


61.62 


-0.92, 






















65.3 


59.2 


62.97 


-3.78* 


53.8 


61.2 


58.65 


2.54 


64.5 


64.5 


62.38 


2.11 




R^AHino Conn 


64.1 


61.% 


62.46 


-1.06 


56.2 


66.0 


62.25 


3.75* 


64.6 


62.9 


62.43 


0.47 




R*a(\\ na Total 


65.6 


61.* 


63.09 


-1.69 


56.0 


65.4 


61.95 


3.45* 


66.4 


63.3 


63.18 


0.11 






56. b 


57.7 


59.38 


-1.69 


53.4 


53.6 


58.05 


-4.46* 


54.9 


57.1 


58.36 


-1.27 






55.* 


55.8 


58.78 


-2.98* 


49.4 


52.1 


52.04 


0.05 


58.1 


55.8 


59.70 


-3.91* 




Language Expr 


62.0 


66.1 


61.57 


4.52* 


58.9 


66.7 


66.31 


0.38 


65.3 


60.5 


62.72 


-2.23 


\ 


Language Total 


60.5 


«.9 


60.9* 


4.96* 


57.2 


59.9 


63.75 


-3.85* 


62.0 


58.6 


61 .34 


-2.75* 


* I 


Math Co««p 


66.5 


62.2 


63.47 


-1.28 


55.8 


64.3 


61.65 


2.65 


60.3 


65.7 


60.62 


5.07* 


"I 
w 

L 


Hath C/Ap 


61.0 


61.1 


61.15 


-0.06 


55.4 


59.3 


61.05 


-1.75 


62.2 


62.0 


61.42 


0.58 


Math Total 


67.5 


63.8 


63.90 


-0.11 


56.4 


61.3 


62.53 


-1.25 


61.2 


64.9 


61.00 


3.90* 


i 


Total Battery 


63.5 


60.3 


62.21 


4.09* 


57.9 


63.3 


64.80 


-1.51 


65.1 


61.7 


62.64 


-0.94 


, * 

1 


Rtf Skills 


















61.7 


62.5 


61.21 


1.29 


• \ 
% 


Science 


















65.6 


61.8 


62.85 


-1.05 


\ 


Soc Studies 


















65.7 


61.5 


6'. 89 


-1.39 


* 


Heiress I on 
I'cuatlon 


Y ' - 


61.8 ♦ .42(X 


• 62.52) 




Y' ■ 


61.19 ♦ 1.5(X - 


55.49) 




Y' - 61.62 ♦ .41 (X 


• 62.68) 




f * 


Standard Error 
0' Estimate 


S est 


> 2.80 






S «$t 


- 2.71 






est 


2.40 






» 

\ 



* More than one standard trror of tsttmatt 

— * — — — ^— — — ^ 

TABLE 2, OBSERVED VS. PREDICTED POSTTEST ACHIEVEMENT OF THREE GRADE-LEVEL GROUPS IN ; 
THE TARGET SCHOOL ON THE "COMPREHENSIVE TESTS OF BASIC SKILLS" (CTBS/U) USING A 
- SIMPLE LINEAR REGRESSION OF OBSERVED 1985 POSTTEST NCE MEANS (Y) ON 1984 PRETEST 
MEANS (X) TO PREDICT MEAN POSTTEST ACHIEVEMENT (Y'h 

16 



Word Attack 
Reading Vocabulary 
Reading Comprehension 
Reading Total 
Spelling 

I anguege Mechanics 
Language Expression 
Language Total 
Math Computation 
Math C/A 
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TABLE 3, CHI SQUARE ON THE FREQUENCY OF BOYS AND GIRLS IN FOUR GRADE-LEVEL GROUPS 
IN THE TARGET SCHOOL WHOSE NCE SCORES ON THE "COMPREHENSIVE TESTS OF BASIC SKILLS" 
(CTBS/U) EITHER INCREASED OR DROPPED BETWEEN THE 198*4 PRETEST AND 1985 POSTTEST, 
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achievement on the basis of pretest achievement Identified CTBS/U subtests on 
which student achievement was greater or less than expected, or more 
specifically, beyond one standard error of estimate above or below the 
predicted value. The data on Table 2 support the following statements: 

1) One of the three target grade-level groups exceeded Its predicted 
performance 1n math, while no group fell short of Its predicted performance 1n 
math. 

2) Each grade-level group performed better than predicted 1n a different 
skill area. Group 2-3 excelled 1n language expression and language total, 
Group 3-4 1n reading comprehension and reading total, and Group 4-5 1n math 
computation and math total. 

3) Group 2-3 lagged behind Its predicted achievement level 1n reading 
vocabulary and language mechanics, Group 3-4 1n spelling and language , total , 
and Group 4-5 1n language mechanics and language total. , 



Chi Square . Results of Ch1 Square analyses on the frequency of boys and girls 
TlTtne target school whose CTBS/U scores either Improved or dropped are listed 
on Table 3. Chi Square values were computed from 2x2 contingency tables with 
change 1n performance.. (up/down)_ a.od_sex _i)f..^tudeat_(J)oyyglrl)..Ai_vAc1ables... 
Ch1 Square was not computed when any cell on a contingency table had fewer 
than five students. Students with Identical pretest and posttest scores were 
not Included 1n the analyses. The data on Table 3 support the following 
statements: 

1) The only instance in the target school where a significant association 
between the change in achievement level and the sex of student was in language 
expression for Group 4-5. Boys in Group 4-5 dropped 1n language expression 
achievement between pretest and posttest while girls maintained their 
achievement level. 

.?) In math computation, 63% (107/171) of the students 1n the target school 
had a higher posttest score than pretest score while 34X (59) slipped lower on 
the posttest. Also 1n math computation, 66% (63/96) of the boys and 59% 
(44/75) of the girls had higher posttest scores than pretest scores while 34% 
(33) of the bo;s and 35* (26) of the girls slipped lower on the posttest. 
Chance expect* don 1s that an equal number or percentage of student scores 
would gain and slip. 

Further percentage breakdowns in the target school for Increases and drops in 
math computation between pretest and posttest include: 
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62 
32 
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44 
67 
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53 
33 
38 



J 
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The only grade-level group 1n the target school that did not .egister 
significant Improvement 1n math computation, Group 2-3, 1s also the only group 
In which the percentage of girls with lower posttest scores exceeded the 
percentage of girls with higher pretest s:ores. 



STUDENT ATTITUDE 

Student attitude results of target school students are displayed on Table 4 (t 
test, change 1n pre-post mean ratings) and Tasle 5 (regression, obtained vs. 
predicted posttest ratings). Table 6 shows Chi Square results on attitude 
differences between target vs. comparison students. 

The t-test . Composite attitude ratings (academic, climate and computer) of 
students - 1n~the~~target "school who" were - pre sent— for "the ~ -984 and 1985 
administrations of the Student Attitude Survey (SAS) are listed on Table 4. A 
two-tailed, repeated measures t test was computed on the difference between 
the pre-post mean ratings for each grade-level group. The data on Table 4 
support the following statements: 

1) Group 1-2 had no significant pre-post changes In mean ratings on any of 
-the SAS composites, neither-academic^-climate nor computer. 

2) Group 2-3 had a significant decrease 1n the SAS computer composite, but 
not in the academic or climate composites. Significant pre-post drops 1n 
three computer factors (computer face, computer 1s easy to use, and computer 
makes learning more fun) contributed to the lower computer composite rating. 

3) Group 3-4 had a significant decrease in the SAS academic composite, but 
not in the climate or computer composites. Significant pre-post rating drops 
in two curriculum areas (language arts and music) contributed to the lower 
academic composite rating. 

4) Group 4-5 had no significant changes 1n pre-post mean ratings cn any of 
the SAS composites, neither academic, climate nor computer. 

Regression . Results of the regression analyses on mean Student Attitude 
Survey scores of target school students are listed on Table 5. A slmpie 
linear regression of mean posttest scores on mean pretest scores was conducted 
with nine curriculum areas and the academic compos.ite providing 10 paired 
scores. Using regression techniques to predict posttest ratings on the basis 
of pretest ratings Identified curriculum areas on which student observed 
ratings were greater or less than expected, or more specifically, beyond one 
standard error of estimate above or below the predicted value. The data on 
Table 5 support the following statements: 

1) One of the four target grade-level groups (Group 3-4) exceeded Its 
predicted mean rating of mathematics, while one group (Group 1-2) fell short 
of its predicted rating 1n math. In Group 2-3 and Group 4-5 posttest ratings 
of mathematics were about as predicted. 

2) In the target primary grades (Group 1-2 and Group 2-3) student posttest 
ratings exceeded expectation for PE and art, while in the intermediate grades 
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TABLE <4. REPEATED MEASURES T TEST ON THE CHANGE IN MEAN RATINGS OF FOUR GRADE-LEVEL 
GROUPS IN THE TARGET SCHOOL ON 1984 PRETEST AND 1985 POSTTEST ADMINISTRATIONS OF THE 
"STUDENT ATTITUDE SURVEY." 
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TABLE 5, OBSERVED VS, PREDICTED POSTTEST CURRICULUM/ACADEMIC RATINGS OF FOUR 
GRADE-LEVEL GROUPS IN THE TARGET SCHOOL ON THE "STUDENT ATTITUDE SURVEY'' USING 
A SIMPLE LINEAR REGRESSION OF OBSERVED 1985 POSTTEST MEANS (Y) ON 1984 PRETEST 
MEANS (X) TO PREDICT MEAN POSTTEST RATINGS (Y'), 
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9 
6 
11 
11 
8 

9 
15 

1 
15 
11 

21 
15 
19 



4 

13 
8 

10 
8 
1 

15 
8 
11 

5 
14 
13 
11 
11 

3 
8 
5 
1 
11 

14 
18 
9 



(n-3'7) 



0.40 
0.13 
1.74 
1.47 

0.00 
2.13 
1.85 



0.00 
0.39 
0.23 



2.13 

0.39 

1.15 
0.01 
14.87** 



1 

12 
11 
17 
12 
21 
12 
9 
14 

6 
6 
20 
13 
7 

4 

9 

1 

. 4 
11 

14 
18 
5 



4 

19 
14 
16 
17 
2 

14 
19 

12 

6 

17 
8 

11 
9 

15 
19 
5 
13 
13 

23 
16 
26 



(n«38) 



2 

16 
14 
12 
5 
3 
7 
11 
11 

4 

6 
13 
4 

. 9 

3 
11 
0 
6 
12 

10 
11 
12 



8 
13 
13 
14 
14 

6 
13 
18 
15 

9 
17 
10 
12 

9 

18 
3 
6 
4 

23 
24 
15 



(n-36) 



1.04 
0.08 
0.02 
0.58 

0.21 
0.03 
0.31 



0.11 
0.66 

0.00 



0.03 



0.17 
2.45 
4.30* 



2 
7 
9 
11 
7 
3 

13 
14 
13 

3 
8 
12 
7 
8 

3 

14 



2 

12 

10 
12 
14 



6 
18 

21 
11 
19 
10 
12 
14 
17 

6 

13 
10 
12 
11 

12 
14 

-4 
10 
7 

25 
16 
21 



(n-36) 



3 
7 
11 
9 
7 
7 

14 
16 
24 

9 
9 

15 
8 

10 

4 

16 
-1- 
8 
14 

21 
20 
18 



9 
14 

15 
19 
12 
3 

17 
16 
6 

6 
9 
13 
14 
17 

6 
16 
4 
9 
8 

19 
19 
14 



(n-42) 



* p<.05 



0.00 
0.46 
0.98 
0.15 

0.06 
0.07 
7.05** 



0.18 
0.05 
0.09 
0.00 



0.07 

0.09 

3.48 
0.19 
1.18 



3 
17 
21 
14 
15 

7 

14 

23 
21 

3 
9 
16 
14 
17 

?t 
23 
2 
5 
14 

19 
23 
17 



10 
12 
12 
14 
18 
10 
20 
9 
11 

5 
10 
13 
14 

9 

11 
9 
11 
13 
14 

22 
16 
17 



(n-44) 



0 
11 
16 
10 
11 

2 

16 
13 

7 

5 
11 
13 

6 
10 

2 
13 
1 
6 
15 

16 
14 
16 



5 
11 
11 
15 
13 
4 
8 
11 
15 

3 
15 
11 
15 
14 

'8 
11 
3 
6 
6 

17 
16 

12 



(n-36) 



** o<.01 



TABLE 6, CHI SQUARE ON THE FREQUENCY OF TARGET STUDENTS AND COMPARISON STUDENTS 
IN FOUR GRADE-LEVEL GROUPS WHOSE RATINGS ON THE "STUDENT ATTITUDE SURVEY" EITHER 
INCREASED OR DROPPED BETWEEN THE 1984 PRETEST AND 1985 POSTTEST . - 



00 . 



25 



BEST COPY 



student posttest ratings of mathematics (Group 3-4) and science (Group 4-5) 
were higher than predicted. 

3) Target school subjects with ratings lower than predicted Include math 
(Group 1-2) , language arts and music (Group 3-4), and reading (Group 4-5). 
Group 2-3 had no subject rating below Its predicted level'. 

Chi Square . Results of Chi Square analyses on the frequency of target 
students and comparison students whose composite ratings on the Student 
Attitude Survey either Improved or dropped are listed on Table 6. Chi Square 
values with correction for continuity were calculated from 2a2 contingency 
tables with change In pre-post rating (up vs. down) and school (target vs. 
comparison) as variables. Chi Square was not computed when any cell on a 
contingency table had fewer than five students. Students with Identical 
pretest and posttest ratings were not Included in the analyses. The data on 
Table 6 support the following statements: ; 

! i 

1) There was no significant difference 1n the frequency of target^and 
comparison students whose pre-post academic composite ratings either gained or 
slipped for any of the four grade-level groups. 

2) There was no significant difference 1n the frequency of target and 
comparison students whose ore-post climate* composite ratings either gained or 
slipped for any of the four grade- level groups. 

3) There were significant differences between target students and comparison 
students In frequency of change 1n computer composite ratings In Group 1-2 and 
Group ?-3> both favoring the comparison students. In Group 1-2, more target 
students gave a lower posttest rating than a higher rating while more 
comparison students gave a higher posttest rating than a lower rating. In 
Group 2-3, both target and comparison students gave more lower than higher 
posttest ratings, but the drop was greater among target students. 

4) There was no significant difference 1n the frequency of target and 
comparison students whose pre-post computer composite ratings either gained or 
slipped for Group 3-4 or Group 4-5. 



•STAFF ATTITUDE 

Staff profiles and mean ratings from the pre-post administrations of the 
2l-1tem, 7-step semantic differential about computer assisted Instruction are 
presented on Table 7. The 2l-1tem general CAI profile Included three 5-1tem 
subproflles: Importance of CAI, Productivity of CAI, and Staff comfort with 
using CAI. A one-tall sign test of profile pattern was applied to the four 
profiles to determine 1f staff attitudes changed significantly during the 
first year of WICAT operation. The probability that with fewer than five 
exceptions the posttest means would fall consistently to either side of the 
pretest means is less than .05 for the general profile. The probability that 
all posttest means would fall to either slo of the pretest means is less than 
.05 for the subprofiles. The data on Table 7 support the following 
statements: 
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PtHwInklt Stiff CAI ProflWi 



Avtrapj Rating 



Standard Deviation 








1986 


1985 


DIFF. 




1986 


1985 


Unimportant 


1. 


5.27 


4.77 


-0.50 


1. 


1.70 


1.68 


Frill 


2. 


6.66 


3.6* 


-1.00 


2. 


1.60 


1.59 


Unnocmory 


J. 


5.00 


4.23 


-0.77 


3. 


1.60 


1.51 


Uttlttt 


6. 


6.18 


5.65 


-0.73 


4. 


.96 


1.26 


Worthltst 


S. 


5.95 


5.18 


-0.77 


5. 


1.13 


1.16 


Unproductive 


6. 


5.91 


5.36 


-0.55 


6. 


1.19 


.95 


Intffleltnt 


7. 


5.73 


5.27 


-0.60 


7. 


1.03 


1.28 


Limiting 


a. 


5.86 


6.55 


-1.31 


6. 


.99 


1.76 


InafftCtlvo 


9. 


5.50 


6.95 


-0.55 


9. 


1.06 


1.36 


Tiro Consuming 


10. 


5.09 


6.32 


-0.77 


10. 


1.5* 


1.67 


Unknown 


11. 


4.18 


5.68 


♦1.50 


11. 


1.68 


1.09 


Fruttratl ng 


12. 


6.16 


6. 59 


♦0.65 


12. 


1.08 


1.22 


Punllnn 


13. 


4.91 


5.66 


♦0.73 


13. 


1.36 


.95 


Confuting 


16. 


4.68 


5.45 


♦0.77 


16. 


1.32 


.86 


Compllctttd 


15. 


3.91 


4.23 


♦0.32 


15. 


1.31 


1.02 


M 


16. 


6.05 


5.41 


-0.64 


16. 


1.17 


1.26 


Foolish 


17. 


5.66 


4.77 


•1.09 


17. 


1.17 


1.68 


Boring 


18. 


6.73 


4.77 


-1.96 


18. 


,55 


1.61 


Expontlvo 


19. 


2.18 


1.95 


•0.23 


19. 


1.60 


1.79 


Ettetlvt 


20. 


3.77 


3.50 


•0.27 


20. 


1.68 


2.06 


1 Can't 


21. 


6.09 


6.65 


♦0.36 


21. 


1.56 


.80 



196<t (n-22) 



1965 t>22) 



no 
o 



TABLE 7, GAI PROFILES* MEAN RATINGS AND STANDARD DEVIATIONS OF TARGET SCHOOL STAFF FROM . 
1984 AND 1985 ADMINISTRATIONS OF THE "STAFF SURVEVs COMPUTER ASSISTED INSTRUCTION," 
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1) There was no significant difference between the staff's 1984 general CAI 
profile and Its 1985 general CAI profile. Profiles from both years were 
typically favorable toward computer assisted Instruction. 

2) There was a significant difference In staff attitude between 1984 and 1985 
on each of the three CAI subproflles. The staff gave lower ratings to the 
importance (5.41 to 4.65) and productivity (5.62 to 4.89) of CAI after a year 
of experience, but felt more comfortable using computer assisted Instruction 
(4.36 to 5.12). 

3) Thirty-six (36) of the staff's 42 mean ratings w*re favorable toward 
computer assisted Instruction. The staff gave two Items (reasonable-expensive 
and required-elective) unfavorable ratings on both pretest and posttest. One 
item (essential-frill) noted a pre-post staff shift from slightly favorable to 
slightly unfavorable. On another Item (simple-complicated) the staff rating 
changed from slightly unfavorable to slightly favorable. ! 

4) The single largest pre-post change in staff mean rating (-1.96) was on the 
Interesting-boring adjective pair, which went from extremely Interesting to 
slightly Interesting. The smallest pre-post change In staff mean rating 
(-0.23) was on the -easonable-expenslve adjective pair, which went from quite 
expensive to extremely expensive. 



PARENT ATTITUDE 



Parent profiles and mean ratings from the pre-post administrations of the 
15-1 tern, 7-step semantic differential about computer assisted Instruction are 
presented on Table 8. The 15-1tem general CAI profile Included two 5-1tem 
subproflles: Importance of CAI and productivity of CAI. A one-tall sign test 
of the profile pattern was applied to the three profiles to determine If 
parent attitudes changed significantly during the first year of WICAT 
operation. The probability that with fewer than three exceptions the 15 
posttest means would fall consistently to either side of the pretest means Is 
less than .05 for the general profile. The pretest means Is less than .05 for 
the general profile. The probability that all posttest means would fall to 
eltrier side of the pretest means Is less than .05 for the subproflles. The 
.data on Table 8 support the following statements: 

1) The 1984 parent general CAI profile was significantly different from the 
1985 parent general CAI profile. Profiles from both years were typically 
favorable toward computer assisted instruction, but 14 of 15 posttest ratings 
were slightly lower than the corresponding pretest ratings. 

2) There was a significant difference on both parent CAI attitude subproflles 
between 1984 and 1985. Parents gave lower, but still favorable, ratings to 
the importance of CAI (5.94 to 5.46) and to the productivity of CAI (5.84 to 
5.53) after a year of experience with the WICAT Hydra system. 

3) Twenty-six (26) of the parent's 30 mean ratings were favorable toward 
computer assisted Instruction. Parents, like the staff, gave two items 
(reasonable-expensive and required-elective) unfavorable ratings on both 
pretest and posttest. 
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Periwinkle Parent CAI Prof 11 •» 



Average Rating 



Standard Deviation 



♦ 1. 

1 . Important 

2. Essential 
J. Necessary 
k. Useful 

5. Valuable 

6. Productive 

7. Efficient 

8. Expanding 

9. Effective 

10. Time Saving 

11. Good 

12. Wise 

13. Interesting 

14. Reasonable 

15. Required 

♦ 7, 





m 




198* 


1985 


DIFF. 




198* 


1985 


Unlaportsnt 


1. 


6.0* 


5.60 


-0.** 


1. 


MS 


1.6* 


Frill 


2. 


5.51 


e.97 


-0.5* 


2. 


1.58 


1.69 


Unnecessary 


3. 


5.86 


5.37 


-0.*9 


3. 


Ml 


1.60 


Useless 


*. 


8.17 


5.69 


-0.*8 


*. 


1.19 


1.61 


Worthless 


5. 


6.11 


5.67 


-0.** 


5. 


1.17 


1.40 


Unproductive 


6, 


5.92 


5.56 


-0.36 


6. 


1.35 


1.36 


Inefficient 


7. 


6.02 


5.61 


-0.*1 


7. 


1.3* 


1.55 


Limiting 


8. 


5.89 


5.56 


-0.33 


8. 


1.30 


1.39 


Ineffective 


9. 


5.82 


5.66 


-0.16 


9. 


Ml 


1.41 


Tlae Consuming 


10. 


5.56 


5.26 


-0.28 


10. 


MS 


1.5* 


Bad 


11. 


6.16 


5.85 


-0.31 


11. 


1.27 


1.3* 


Foolish 


12. 


5.86 


5.57 


-0.29 


12. 


1.40 


1.42 


Boring 


13. 


6.23 


5.7* 


-0.*9 


13. 


1.13 


1.55 


Expensive 


1*. 


3.60 


3.6* 


-0.16 


1*. 


1.77 


1.77 


Elective 


15. 


3.10 


3.3* 


♦0.2* 


15. 


1.80 


1.91 



Key: 198* (n-1*2) ~ — 1985 (n-163) 

TABLE 8, CAI PROFILES* MEAN RATINGS AND STANDARD DEVIATIONS OF TARGET SCHOOL PARENTS FROM 
1984 AND 1985 ADMINISTRATIONS OF THE "PARENT SURVEY: COMPUTER ASSISTED INSTRUCTION." 
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V. DISCUSSION AND ONCLUSIONS 



Teachers at Periwinkle Elementary School, using the WICAT system as a tool, 
promoted significant gains 1n their students' math achievement scores on a 
standardized test. These gains essentially paralleled achievement gains 1n 
schools of other districts using computer assisted Instruction. The staff and 
parents at Periwinkle typically rated computer assisted Instruction as an 
Important and productive practice at the elementary school level. 



STUDENT ACHIEVEMENT * 

Periwlr.kle students 1n three of four grade-level groups using the WICAT system 
enjoyed statistically significant Increases of CTBS/U scores In math 
computation and math total when compared to the norm group. Math total was 
the only "total subject" score on the CTBS/U for which all significant changes 
1n student achievement were positive. Unlike math computation and math! total, 
however, none of the Albany grade-level groups using WICAT marked significant 
change 1n math concepts and applications, either positive or negative. These 
findings about WICAT computer assisted Instruction results are consistent with 
the results observed 1n the Pasco (Washington) schools with the MIcroHost 
Instructional System, a WICAT competitor. In Pasco, students using MIcroHost 
were up 1n (CTBS/U and California Achievement Tests) math computation and math 
total when compared to other district math programs, but not-1n math concepts 
and applications. 

Math achievement Increased significantly among WICAT students 1n three 
different "achievement environments." In one environment where a WICAT 
grade-level group experienced significant gains and drops 1n other CTBS/U 
subjects, the students had significant gains in math computation and math 
total. In a second environment where a WICAT gr?de-1eve1 group experienced 
several significant gains across the CTBS/U subjects Including total battery, 
the students also had significant gains 1n math computation and math total. 
In a third environment where a WICAT grade-level group experienced several 
significant drops across the CTBS/U subjects Including total battery, the 
students countered with significant drops across the CTBS/U subjects Including 
total battery, the students countered with s1gi1f1cant gains 1n math 
computation and math total. 

Even though NCEs, percentiles and other standard test scores lack the zero 
value characteristic of a ratio scale that permits the computation of 
percentages, change 1n student achievement scores 1s often reported as a 
"growth percentage." p or example, a junior high school 1n Oxnard (California) 
with the WICAT system reported: "We had a 10 percent growth 1n the, area of 
(6th grade CT8S) math and felt 1t significant." Albany math computation 
results reported this manner compares quite favorably with the Oxnard results. 
The mean NCE gain of 5.4 for Group 4-5 was a 9 percent growth; the mean NCE 
gain of 8.4 for Group 3-4 was a 15 percent growth; and, believe 1t or not, the 
mean NCE gain of 15.4 for Group 1-2 was a 27 percent growth. 

Boys and girls at Periwinkle School seemed to benefit similarly 1n math 
achievement from computer assisted instruction provided by the WICAT system. 
This finding disagrees with a study completed at the University of Illinois at 
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Chicago — a secondary analysis of several different research efforts — that 
concluded boys using computers achieve more than girls. ( School TechNews . 
February 1985, p. 1.) 

In 1984 before WICAT was Implemented, mean math scores for all grade-level 
qroups at Periwinkle were above the national norm. In 1985 after one year of 
using WICAT, mean math scores for all grade-level groups at Periwinkle were 
still above the national norm, but several of those mean scores were even 
significantly higher than In 1984. 



STUDENT ATTITUDES 

Significant Improvement In math achievement was not necessarily related to the 
students' attitude toward math. The grade-level group of students with the 
most dramatic gain in math achievement also exhibited a significant 
unfavorable change from a positive to a negative attitude toward math. None 
of the other grade-level groups had a significant change In attitude toward 
math; they maintained their positive attitudes toward math through their first 
of computer assisted Instruction. 

Attitudes of Periwinkle students toward math dropped significantly from a 
positive (3.58) to a negative (2.78) rating In Group 1-2, but remained 
essentially the same (positive) 1n the other three grade-level groups. 

Computer composite ratings of Periwinkle Group 2-3 students dropped 
significantly between 1984 (4.44) and 1985 (4.20), but remained quHe positive 
even after the drop. Changes In student attitudes toward computers, as shown 
by the computer composite rjting, differed significantly between Periwinkle 
students and "comparison students" In Group 1-2 and Group 2-3, both 
differences In favor of the comparison students. At Periwinkle, 
student-computer Interaction Is frequent and routine, and It Involved a 
considerable amount of the hard work of learning basic skills. At the 
comparison school, which has a limited number of microcomputers, 
student-computer Interaction was relatively Infrequent, and It often Involved 
computer games and learning reinforcement activities. While students In the 
lower grades tended to think less of the computer after a year of WICAT 
experience, It should be strongly noted that the computer composite ratings of 
all four Periwinkle grade-level groups were quite positive In 1984 and 
remained quite positive In 1985. 



PARENT AND STAFF ATTITUDrS 

Parent and staff gave favorable ratings to the Importance and productivity of 
computer assisted Instruction, both l.i 1984 before WICAT was operational and 
in 1985 after a year of experience with the system. The 2985 parent and staff 
surveys were conducted before the student CTBS/U achievement results were 
available. Ratings of WICAT productivity may have been higher if these 
results were available before parents and staff received the follow-up survey. 
In contrast to the generally favorable ratings for computer assisted 
instruction, both staff and parents acknowledged a concern about WICAT costs 
on the 1984 and 1985 surveys. 
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In the excitement of plannlnn for and 1n Implementing the use of a new, 
high-tech teaching tool, 1t is likely that some staff members developed 
unreallstlcally high expectations about what computer assisted Instruction 
could and should accomplish In the elementary school. Apparently a year of 
experience with the WICAT system adjusted staff expectations to reality. 
Nonetheless, the experienced staff generally rated computer assisted 
Instruction as both Important and productive. The staff also reported a 
higher comfort level 1n using the program after one year of hands on 
experience. 

The concern about WICAT costs expressed by some parents originates 1n a belief 
that computer assisted Instruction should or could be delivered through a room 
full of smaller, M less expensive" microcomputers rather than the larger, "very 
expensive" minicomputer. A study conducted at Stanford University found that 
the cost of delivering computer assisted Instruction 1s slightly less with 
more powerful minicomputers than with microcomputers, considering hardware and 
maintenance costs only. This "small cost advantage would be substantially 
greater 1f one were to account for all of the Ingredients and their cost, 
especially 1n personnel needs." The microcomputer network "at present 1s 
complex and unpredictable enough to require substantially greater surveillance 
and knowledge... by the coordinator than does the minicomputer approach." 
( SchoolTechNews , February 1985, p. 2..) 



SUMMARY 

The math program at Periwinkle Elementary School consisted of regular 
instruction using the Real Math curriculum 1n the classroom and WICAT computer 
assisted Instruction 1n the lab. Students, parents and staff generally gave 
favorable ratings to computer assisted Instruction. In the first year of this 
program, student achievement scores In math computation and math total 
increased significantly, even dramatically, 1n three of four student 
grade-level groups. This Improved math achievement was apparently unrelated 
to student attitudes toward math or computers; student math and computer 
attitudes vacillated while achievement scores Improved. In addition, boys and 
girls similarly enjoyed Improved math scores. Indeed, the first year of the 
Periwinkle math program, of which WICAT computer assisted instruction was a 
part, was effective. Two considerations suggest that the WICAT system 1s 
closely associated with the improved math performance. First, each of the 
student groups with significant math gains made those gains under a different 
"achievement environment." Second, the pattern of Improved math scores at 
Periwinkle was consistent with the pattern of improved math scores reported in 
other schools that have used computer assisted instruction. 
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SURVEY 



School 
Grade . 



- Name 

- Date . 



AA ® © © 



BB 



1. 



2. 



© © © 



STUDENT ATTITUDE SURVEY 



3/65 



AA What face do you wear when you are eating spinach? 

BB What face do you wear when you are eating "gizwaz"? 

1 What face do you wear when it's time to go to school? 

2 What face do you wear when you are learning math? 

3 What face do- you wear when you are doing art? 

4 What face do you wear when you are learning science? 

5 What ace do you wear when you are working on reading? 

6 What face do you wear when you are doing music? 

7 What face do you wear when you are at recess? 
6 What. face do you wear when you are doing social studies? 
9 What face do you wear when you are working on a computer? 

10 What face do you wear when you are learning health? 

11 What face do you wear when you are at the school library? 

12 What face do you wear when you are doing language arts? 

13 What face do you wear when you are in PE? 
CC Do you think spinach tastes good? 

14 Do you think computers are easy to use? 

15 Do your think kids like this school? 

16 Do you think computers make learning more fun? 

17 Do you like the school work that you do? 

18 Do you think computers made learning easier? 

19 Do you think there are a lot of nice things to do at school? 
£0 Do you think computers are scary? 

Academic Compositei Items 2-3-4-5-6-8-1 0-1 2-13 
Climate Compositei Items 1-7-15-17-19 
Computer Compositei Items 9-14-16-18-20 




15. 


1 ISifi* ^ 




"'MA x osk 


no 


NO 


17. 


YES 


yes 


MAYBE 


no 


NO 


18. 


YES 


yes 


MAYBE 


no 


NO 


19. 


YES 


yes 


MAYBE 


no 


NO 


20. 


YES 


yes 


MAYBE 


no 


NO 
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^mStaff Survey: Computer Aaaltted Instruction 
f Greater Albany Public Schools 



PERIWINKLE 1965 



Compute r Assisted Instruction makes use of a computer to present Instruction, to holp teach students. 
Simple computer activities Include rota drill and practice, with the computer serving at drill matter 
and record keeper. Complex activities nay Involve dialog aysteM* where student and computer Interact 
In sophisticated problem solving activities. 

INSTRUCTIONS . After reeding the statement above, Indicate how you feel about computer assisted 
Instruction, circle the number between eech of the pairs of adjectives that best reflects your think- 
Ing right now. 



COMPUTER ASSISTED INSTRUCT ION 



1. 


good 


2. 


•»»en t.il 


3. 


familiar 


e. 


useless 


5. 


wl at 


6. 


boring 


7. 


Important 


S. 


frustrating 


9. 


necessary 


10. 


unproductive 


11. 


s.lmple 


12. 


expensive 


13. 


inefficient 


1*. 


expanding 


15. 


understandable 


16 


worthiest 


17. 


cort using 


18. 


required 


19. 


effective 


20. 


time consuming 


21. 


1 can 



.2. 
.2. 
.2. 
.2. 
.2. 



.3. 
.3. 
.3. 
.3. 



.5. 
.5. 
.5. 
.5. 
.5. 



.6. 
.6. 
.6. 
.6. 
.6. 



.7 
.7 
.7 
.7 
.7 



bad 

frill 
unknown 
useful 
foolish 



.2. ..3. 5... 6.. .7 Interesting 

.2. ..3. 5... 6.. .7 unimportant 

.2. ..3. 5.. .6. ..7 easygoing 

.2...3...e..^5...6...7 unnecessary 

.2. ..3. 5.. .6.. .7 productive 

.2...3...e...5...6...7 complicated 

.2. ..3. 5.. .6.. .7 reasonable 

.2...3...e...5...6...7 efficient 

.2. ..3. 5.. .6.. .7 limiting 

.2. ..3. 5.. .6.. .7 puzzling 

.2.. .3.. e...5...6...7 valuable 

.2. ..3. 5... 6.. .7 deer 

.2. ..3. 5.. .6.. .7 elective 

.2. ..3. 5.. .6.. .7 Ineffective 

.2. ..3. 5.. .6.. .7 time saving 

.2...3...S...5...6...7 I can't 



22. C • ~t t» (optional )» 



23. Level: Elementery M iddle H igh School 
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^Parent Survey: Computer Aetlated Inotruction 
Greater Albany Public Schools 

PERIWINKLE 1985 

Computer Assisted Instruction makes un of a computer to present Instruction, to help trach students. 
S1 rrpl© computer activities include rota drill and practice, with tha computar sarvlng as drill master 
and record keeper. Complex activities may Involve dialog systems where student and computer Interact 
In sophisticated problem solving activities. 

INSTRUCTIONS , After reading the statement above, Indicate how you feel about computer assisted 
Instruction. A M 1" or n 7 M on the scale shows strong feeling one way or the other; a "V 1 Is neutral,^ 
Please circle the nimber between each of the adjective pairs that beat reflects your opinion. 

COMPUTER ASSISTEO INSTRUCTION 



1. 


good 
















bad 


t. 


frill 
















essential 


3. 


efficient 
















Inefficient 


k. 


foolish 
















wise 


5. 


Important 


It. 


.2. 






..5. 


• . 6 . 


..7 


unimportant 


6. 


expanding 
















limiting 


7. 


expensive 
















reasonable 


dv 


necessary 
















unnecessary 


9. 


productive 
















unproductive 


10. 


boring 
















Interesting 


11. 


useful 
















useless 


12 


effective 
















Ineffective 


13. 


elective 
















requl red 


H. 


valuable 








i, 








worthless 


15. 


tfme consuming 
















time s^vltig 



16. Comments (optional): 




